Skip to content

Hadoop 16524 - resubmission following some unit test fixes#2693

Merged
saintstack merged 8 commits intoapache:trunkfrom
bolerio:HADOOP-16524
Mar 31, 2021
Merged

Hadoop 16524 - resubmission following some unit test fixes#2693
saintstack merged 8 commits intoapache:trunkfrom
bolerio:HADOOP-16524

Conversation

@bolerio
Copy link
Contributor

@bolerio bolerio commented Feb 9, 2021

This is a follow up on this PR which was rejected due to some failed unit tests #2470 that were missed initially.

Most of the failures reported here appears to be flaky tests as they passed when run locally:

https://issues.apache.org/jira/browse/HADOOP-16524?focusedCommentId=17262765&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17262765

I've address the one test that was clearly broken by the PR and also including another unit test fix in the same vein.

@hadoop-yetus
Copy link

hadoop-yetus commented Feb 9, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 17s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 0m 0s test4tests The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 13m 57s Maven dependency ordering for branch
+1 💚 mvninstall 23m 9s trunk passed
+1 💚 compile 22m 27s trunk passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚 compile 19m 0s trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚 checkstyle 3m 59s trunk passed
+1 💚 mvnsite 7m 56s trunk passed
+1 💚 shadedclient 27m 41s branch has no errors when building and testing our client artifacts.
+1 💚 javadoc 4m 49s trunk passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 5m 30s trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+0 🆗 spotbugs 1m 51s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 18m 54s trunk passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 21s Maven dependency ordering for patch
+1 💚 mvninstall 6m 56s the patch passed
+1 💚 compile 21m 39s the patch passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚 javac 21m 39s the patch passed
+1 💚 compile 19m 20s the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚 javac 19m 20s the patch passed
-0 ⚠️ checkstyle 4m 1s /diff-checkstyle-root.txt root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚 mvnsite 8m 44s the patch passed
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 xml 0m 1s The patch has no ill-formed XML file.
+1 💚 shadedclient 15m 54s patch has no errors when building and testing our client artifacts.
+1 💚 javadoc 5m 0s the patch passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 5m 53s the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚 findbugs 21m 4s the patch passed
_ Other Tests _
+1 💚 unit 17m 39s hadoop-common in the patch passed.
+1 💚 unit 2m 18s hadoop-hdfs-client in the patch passed.
-1 ❌ unit 240m 53s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 4m 7s hadoop-yarn-common in the patch passed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
515m 28s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart
hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
hadoop.yarn.server.timelineservice.storage.TestTimelineWriterHBaseDown
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml
uname Linux 74b0f841c262 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 2df2dfb
Default Java Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/testReport/
Max. process+thread count 1681 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/console
versions git=2.25.1 maven=3.6.3 findbugs=4.0.6
Powered by Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

hadoop-yetus commented Feb 12, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 23m 9s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 0m 0s test4tests The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 13m 48s Maven dependency ordering for branch
+1 💚 mvninstall 22m 44s trunk passed
+1 💚 compile 22m 14s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 18m 58s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 checkstyle 3m 57s trunk passed
+1 💚 mvnsite 12m 35s trunk passed
+1 💚 shadedclient 32m 28s branch has no errors when building and testing our client artifacts.
+1 💚 javadoc 7m 37s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 0s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+0 🆗 spotbugs 12m 23s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 31m 2s trunk passed
_ Patch Compile Tests _
+0 🆗 mvndep 0m 20s Maven dependency ordering for patch
+1 💚 mvninstall 11m 29s the patch passed
+1 💚 compile 21m 43s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javac 21m 43s the patch passed
+1 💚 compile 18m 54s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 javac 18m 54s the patch passed
-0 ⚠️ checkstyle 3m 59s /diff-checkstyle-root.txt root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚 mvnsite 12m 36s the patch passed
-1 ❌ whitespace 0m 0s /whitespace-eol.txt The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 💚 xml 0m 2s The patch has no ill-formed XML file.
+1 💚 shadedclient 15m 19s patch has no errors when building and testing our client artifacts.
+1 💚 javadoc 7m 36s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 7m 59s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 findbugs 31m 51s the patch passed
_ Other Tests _
+1 💚 unit 17m 6s hadoop-common in the patch passed.
+1 💚 unit 2m 18s hadoop-hdfs-client in the patch passed.
-1 ❌ unit 232m 25s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 4m 7s hadoop-yarn-common in the patch passed.
-1 ❌ unit 227m 28s /patch-unit-hadoop-yarn-project.txt hadoop-yarn-project in the patch passed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
800m 35s
Reason Tests
Failed junit tests hadoop.yarn.applications.distributedshell.TestDSTimelineV10
hadoop.yarn.applications.distributedshell.TestDSTimelineV10
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml
uname Linux 36ac8935757d 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / f9a073c
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/testReport/
Max. process+thread count 1245 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/console
versions git=2.25.1 maven=3.6.3 findbugs=4.0.6
Powered by Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

saintstack commented Mar 22, 2021

I see:

[ERROR] Tests run: 21, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 450.303 s <<< FAILURE! - in org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV10
[ERROR] testDSShellWithoutDomain(org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV10)  Time elapsed: 28.293 s  <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<3>

.... and a few other unrelated.

@hadoop-yetus
Copy link

hadoop-yetus commented Mar 24, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 56s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 14m 2s Maven dependency ordering for branch
+1 💚 mvninstall 23m 40s trunk passed
+1 💚 compile 22m 49s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 19m 4s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 checkstyle 4m 0s trunk passed
+1 💚 mvnsite 12m 38s trunk passed
+1 💚 javadoc 7m 38s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 4s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 31m 25s trunk passed
+1 💚 shadedclient 27m 51s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 23s Maven dependency ordering for patch
+1 💚 mvninstall 13m 26s the patch passed
+1 💚 compile 25m 11s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javac 25m 11s the patch passed
+1 💚 compile 21m 47s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 javac 21m 47s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 4m 2s /results-checkstyle-root.txt root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚 mvnsite 13m 5s the patch passed
+1 💚 xml 0m 3s The patch has no ill-formed XML file.
+1 💚 javadoc 8m 9s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 27s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 35m 29s the patch passed
+1 💚 shadedclient 28m 3s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 17m 20s hadoop-common in the patch passed.
+1 💚 unit 2m 17s hadoop-hdfs-client in the patch passed.
-1 ❌ unit 232m 21s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 4m 44s hadoop-yarn-common in the patch passed.
-1 ❌ unit 232m 37s /patch-unit-hadoop-yarn-project.txt hadoop-yarn-project in the patch passed.
+1 💚 asflicense 0m 53s The patch does not generate ASF License warnings.
800m 42s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.TestRMRestart
hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor
hadoop.yarn.server.resourcemanager.TestRMRestart
hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname Linux cb51398718fa 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7763309
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/testReport/
Max. process+thread count 1245 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

hadoop-yetus commented Mar 26, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 1m 3s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 14m 5s Maven dependency ordering for branch
+1 💚 mvninstall 28m 26s trunk passed
+1 💚 compile 28m 38s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 24m 9s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 checkstyle 4m 43s trunk passed
+1 💚 mvnsite 16m 2s trunk passed
+1 💚 javadoc 9m 9s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 9m 22s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 40m 2s trunk passed
+1 💚 shadedclient 34m 15s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 25s Maven dependency ordering for patch
+1 💚 mvninstall 15m 36s the patch passed
+1 💚 compile 31m 14s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javac 31m 14s the patch passed
+1 💚 compile 20m 47s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 javac 20m 47s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 3m 59s /results-checkstyle-root.txt root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚 mvnsite 12m 25s the patch passed
+1 💚 xml 0m 3s The patch has no ill-formed XML file.
+1 💚 javadoc 7m 36s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 7m 57s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 32m 16s the patch passed
+1 💚 shadedclient 28m 4s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 17m 22s hadoop-common in the patch passed.
-1 ❌ unit 0m 56s /patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt hadoop-hdfs-client in the patch failed.
-1 ❌ unit 4m 38s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch failed.
-1 ❌ unit 0m 53s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt hadoop-yarn-common in the patch failed.
-1 ❌ unit 4m 40s /patch-unit-hadoop-yarn-project.txt hadoop-yarn-project in the patch failed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
376m 29s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname Linux 51dd69dcf22b 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7763309
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/testReport/
Max. process+thread count 3136 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

saintstack commented Mar 26, 2021

Unrelated failure:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project hadoop-yarn-common: Compilation failure: Compilation failure: 
[ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-2693/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestTimelineClient.java:[44] error: cannot find symbol
[ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-2693/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestTimelineClient.java:[480,40] error: cannot find symbol

@saintstack
Copy link
Contributor

saintstack commented Mar 29, 2021

Build 5 had compilation error... from elsewhere? Checking local, all compiles now. Retrying...

@bolerio
Copy link
Contributor Author

bolerio commented Mar 30, 2021

Thanks for retrying @saintstack . I did pull latest trunk to check for compilation errors locally and all went fine, must have been a temporary issue from elsewhere.

@hadoop-yetus
Copy link

hadoop-yetus commented Mar 30, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 54s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 0s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 13m 58s Maven dependency ordering for branch
+1 💚 mvninstall 23m 12s trunk passed
+1 💚 compile 22m 34s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 18m 57s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 checkstyle 3m 56s trunk passed
+1 💚 mvnsite 12m 32s trunk passed
+1 💚 javadoc 7m 38s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 5s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 31m 24s trunk passed
+1 💚 shadedclient 27m 51s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 47s Maven dependency ordering for patch
+1 💚 mvninstall 11m 49s the patch passed
+1 💚 compile 21m 39s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javac 21m 39s the patch passed
+1 💚 compile 19m 3s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 javac 19m 3s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 3m 54s /results-checkstyle-root.txt root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚 mvnsite 12m 33s the patch passed
+1 💚 xml 0m 2s The patch has no ill-formed XML file.
+1 💚 javadoc 7m 35s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 7m 59s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 32m 19s the patch passed
+1 💚 shadedclient 28m 0s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 17m 12s hadoop-common in the patch passed.
+1 💚 unit 2m 17s hadoop-hdfs-client in the patch passed.
-1 ❌ unit 231m 46s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
+1 💚 unit 4m 44s hadoop-yarn-common in the patch passed.
-1 ❌ unit 244m 53s /patch-unit-hadoop-yarn-project.txt hadoop-yarn-project in the patch passed.
+1 💚 asflicense 1m 52s The patch does not generate ASF License warnings.
799m 34s
Reason Tests
Failed junit tests hadoop.yarn.applications.distributedshell.TestDSTimelineV15
hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
hadoop.yarn.applications.distributedshell.TestDSTimelineV15
hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname Linux 0e4c8723d26b 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7763309
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/testReport/
Max. process+thread count 1584 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

saintstack commented Mar 30, 2021

Build #4 had these tests fail:
org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV15.testDSShellWithDomain
org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore.testFSRMStateStore

Build #5 had compile issue.

Build #6 failed w/ these issues:

org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart.testRMRestartOnMissingAttempts[FAIR]
org.apache.hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor.testGetApplicationAttemptReport

None seem related. Will run one more build to be sure.

@hadoop-yetus
Copy link

hadoop-yetus commented Mar 31, 2021

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 13m 41s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 codespell 0m 1s codespell was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 4 new or modified test files.
_ trunk Compile Tests _
+0 🆗 mvndep 14m 14s Maven dependency ordering for branch
+1 💚 mvninstall 20m 11s trunk passed
+1 💚 compile 20m 43s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 compile 17m 56s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 checkstyle 3m 47s trunk passed
+1 💚 mvnsite 12m 46s trunk passed
+1 💚 javadoc 7m 48s trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 13s trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 29m 25s trunk passed
+1 💚 shadedclient 24m 26s branch has no errors when building and testing our client artifacts.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 25s Maven dependency ordering for patch
+1 💚 mvninstall 11m 15s the patch passed
+1 💚 compile 20m 0s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javac 20m 0s the patch passed
+1 💚 compile 17m 56s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 javac 17m 56s the patch passed
+1 💚 blanks 0m 0s The patch has no blanks issues.
-0 ⚠️ checkstyle 3m 47s /results-checkstyle-root.txt root: The patch generated 169 new + 93 unchanged - 11 fixed = 262 total (was 104)
+1 💚 mvnsite 12m 37s the patch passed
+1 💚 xml 0m 2s The patch has no ill-formed XML file.
+1 💚 javadoc 7m 45s the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚 javadoc 8m 6s the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚 spotbugs 30m 27s the patch passed
+1 💚 shadedclient 24m 56s patch has no errors when building and testing our client artifacts.
_ Other Tests _
+1 💚 unit 17m 11s hadoop-common in the patch passed.
+1 💚 unit 2m 27s hadoop-hdfs-client in the patch passed.
-1 ❌ unit 226m 44s /patch-unit-hadoop-yarn-project_hadoop-yarn.txt hadoop-yarn in the patch passed.
-1 ❌ unit 1m 10s /patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt hadoop-yarn-common in the patch failed.
-1 ❌ unit 4m 35s /patch-unit-hadoop-yarn-project.txt hadoop-yarn-project in the patch failed.
+1 💚 asflicense 1m 3s The patch does not generate ASF License warnings.
546m 6s
Reason Tests
Failed junit tests hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling
hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit
hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/artifact/out/Dockerfile
GITHUB PR #2693
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname Linux 874fc760dd26 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/bin/hadoop.sh
git revision trunk / 7763309
Default Java Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/testReport/
Max. process+thread count 2754 (vs. ulimit of 5500)
modules C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/console
versions git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

@saintstack
Copy link
Contributor

saintstack commented Mar 31, 2021 •
edited
Loading

Failures this time through are the below, new failures.

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling.testAsyncSchedulerSkipNoRunningNMs
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit.testKillMultipleContainers

Let me merge. Each build has new flakies fail.

@saintstack saintstack merged commit 9509beb into apache:trunk Mar 31, 2021
asfgit pushed a commit that referenced this pull request Mar 31, 2021
@saintstack
Revert "Hadoop 16524 - resubmission following some unit test fixes (#…
5183aae 
…2693)"

Revert to fix the summary message.

This reverts commit 9509beb.
kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021
@bolerio
Hadoop 16524 - resubmission following some unit test fixes (apache#2693)
6a06e65 
Signed-off-by: stack <stack@apache.org>
kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021
@saintstack
Revert "Hadoop 16524 - resubmission following some unit test fixes (a…
6e8a3f2 
…pache#2693)"

Revert to fix the summary message.

This reverts commit 9509beb.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@bolerio @hadoop-yetus @saintstack